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[57] ABSTRACT 

A computer editing system gr^hical user interface 
includes at least one central processing unit (CPU) cou- 
pled through appropriate. input/output (I/O) circuitry 
to input devices, such as a cursor control device, and a 
display device. The CPU is further coupled to a storage 
device for the storage of data and programs including a 
database. The database comprises a plurality of source 
logs indicating a beginning point and an ending point 
defining all the available source material for the corre- 
sponding source log. An output sequence of selected 
source material is displayed on a timclinf as source 
material blocks, wherem tlie source material blocks are 
defined by a head point and a tail point Through the 
computer editing system, a user perfonos a variety of 
re-editing functions to trim existing source material and 
to insert new source material on the timeline. When 
performing a re-edit fimctios, all available source mate- 
rial blocks for a source log selected for re-edit is dis* 
played. The selected source block displayed is visually 
distinguished by size, color and relative layering. By 
distinguishing the selected source block for which re- 
edit is desired, the user b permitted to clearly view all 
the available source material for the selected source 
block. 
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ing systems is that the editing systems often fail to pro- 

GRAPmCAL USER INTERFACE FOR vide the user an organized and visual display of the 

DISPLAYING AVAILABLE SOURCE MATERIAL sonrcc material available to create the output sequence. 

FOR EDITING Without a visual display of the source material, it is 

T>.^T^^n».r^Tn ^^.^^ ^^r^..,^^^. ^ difficult for a user to select source material for editing 

BACKGROUND OF THE INVENnON „ rating of an output sequence As will be de- 

1. Field of the Invention scribed, the present invention provides methods and 
The present invention relates to apparatus and meth- apparatus for viewing available source material for 

ods for displaying graphic information, and more par- executing re-edit functions, 
ticularly, the present invention relates to a computer 

controlled diqilay system for editmg a multi-media SUMMARY OF THE INVENTION 

production. The present invention provides apparatus and meth- 

2. Art Background ods for use in computer display systems, and m particu- 
Ovar the past decade, a variety of graphic user inter- lar, a graphical user inteifece for lise in computer con- 

laca have been developed to «^ human mtetaction " troDed multi-media editing systems. A display system 

with computer sy^. Nfany dBplay systems utihze i„chjding at least one central processing unit (CPU) is 

metaphors m the d^si^ of the mterfacc as a way of through appropriate inp^^^S'ut O/O) cir- 

max^ig h.mm familianty, and conveymg mforma- ^ input devi^ such as a^ursor^ntrol device, 

don bctwem the user and the computer. It is common if further wupled to a storage device to S 

for computer systems mcorporatmg so-called "object 20 *" " " " j ^ . '^^"^'^H" "^vicc loi^e 

oriented" display systems to itilizc Multiple "wmdoivs" *»f '^^ '^J?^ T^"^ * databa«. Tie 

on a display in which combinations of text and graphics *?"P^«* '^^^ °° 

are disposed. The display systems utilize familiar meta- P"*=°' mvention s user interface is displayed. The data- 

phors, such as desktops, control panels, notdxxiks and ^ comprises a plurality of source logs which are 

the like, such that the interface takes advantage of exist- 25 pomters to selected portions of audio and/or video 

ing human mental structures to permit a user to draw source material located on various media resources, 

upon the metaphor analogy to understand the require- Hirough use of the source logs, the computer editing 

ments of the particalar computer system. system controls the various media resources to provide 

It is well known that designing around a femiliar source material for editing or re-cditing of a production, 
metaphor helps reduce human learning time. (Sec for 30 The computer controlled editing system of the pres- 
example, Patrick Chan, "Learning Considerations in cnt invention generates an output sequence of selected 
User Interface Design: The Room Model", Report CS- source material displayed on a timeline. The sonrcc logs 
84-16, University of Waterloo Computer Science De- contain a beginoing point and an ending point defining 
partment, Ontario, Canada, July, 1984, and the refer- all the available source material for the corresponding 
encesdtedtbereiiL) The ability to operate on images or 35 source log. To generate the output sequence on the 
objects which relate the user to actual objects on, for timeline, a portion of a source log is selected by defining 
example, a desktop, results in a stronger man-machine a head point and a tail point The computer controlled 
interface. (See for example, D. Robson. '^Object On- editing system of the present invention permits a user to 
ented Software System^, BYTE, August 1991, page 74, perform a variety of re-editing functions to trim existing 
YS!;i; ®: ^- Smalltalk Environmenr. « gourcc material and to msert new source material on the 
BYTE. August 198 , page 90, Vol 6, No. 8; and Smitii timeline. When performing a re-edit fimction, the com- 
et aL. Star W«»; An Overview . National p„t«- controlled editing system displays all available 
Qmputer Conf««.ce.l982. source material for a soiree log sele^ for re^it To 

Research mmter&ce d«ign usmg metaphors m man- accomplish tins task, a source material block displayed 

machme interfec^may be apphed to coi^uter con- 45 ^ distinSed by size, color and relate Uy- 

trolled editing systems to mcorporate and mtegrate n j J: • u i i • j ""u'a-uvciay 

various prXti^ media resou^ such as sp^ 1^^'^^ "^"^ '''"^'^ 

effects, i^c. graphics and tiie l^Ia the case of an '1'^ P^*^ 

editing system, a variety of resources must be inte- ^ '^"^ *^ '^'^ 

grated, scheduled and coordinated with one another to 50 ^"'^ '^S- 

obtain a complete multi-media product Users of com- BRIEF DESCRIPTION OF THE DRAWINGS 

puter controlled editing systems are generally fainiliar _ 

wifli tiic individual resources and die coordination of "'^ "^-"^ features and advantages of Uie present 

tiiose resources to develop a finished product Acoord- mvention will be apparent from tiie foUowing detailed 

ingly, the 'Svindows" utilized in a video editing system 55 ^description of the preferred embodiment of the inven- 

may be designed such tiiat the metaphor of the interface references to the drawings in which: 

takes advantage of the knowledge of the user in operat- * ' functional block diagram illustrating one 

ing discrete devices (for example, a video tape lecoider possible computer di^lay system incorporating the 

or music synthesizer). The window may, therefore, take teachings of tiie present invention, 

the form of a control panel for the video ta^ recorder, 60 'PIO. 1 illiistrates a graphical user interEace for a com- 

which includes the controls of play, reverse, record and puter editing system configured in accordance with the 

the like. Similarly, the window may provide an area on present invention. 

the display screen in which movies, takes, or particular FIGS. 3a-e tllustrate a graphical user interface for a 

scenes are displayed for the user to edit re<edit insert function configured in accordance with 

A computer controlled editing system may allow a 65 the present invention, 

user of the system to integrate source material from a FIGS. 4a-e illustrate a graphical user mterfacc for an 

variety of multi-media resources to generate an output overlay re-edit fimction configured in accordance with 

sequence. One problem associated with computer edit- the present invention. 
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FIGS. Sd-S/Olustiate a grapbical user interface for a 
Trim 1 mode re~edit function coniiguied in accordance 
with the present invention. 

FIGS. 6a-d illustrate a graphical user intcrfece for a 
Trim 2 function configured in acconlance with the S 
present invention. 

FIGS. 7a-</ illustrate a graphical user interface for a 
Trim 3 function configured in accordance with the 
present invention. 

10 

NOTATION AND NOMENCLATURE 

The detailed descriptions v^iich foUow are presented 
krgely in terms of di^lay images, algoriduns, and sym- 
bolic r^resentations of operations of data bits within a 
conqmter memory. These algorithmic descriptions and IS 
representations are the TTi^an" used by those skilled in 
the data processing arts to most eETectively convey the 
substance of their work to others skilled in the art 

An algorithm is here, and generally, conceived to be 
a self consistent sequence of steps leading to a desired 20 
result These steps are those requiring physical manipu- 
lations of physical quantities. Usually, tiiough not neces- 
sarily, these quantities take the form of electrical or 
magnetic signals capable of being stored, transfeired, 
combined, compared, and otherwise manipulated. It 2S 
proves convenioit at times, principally for reasons of 
common usage, to refer to these signals as bits, values, 
elements, symbols, characters, images, terms, numbers, 
or the like. It should be borne in mind, however, that all 
of these and similar terms are to be associated with the 30 
appropriate physical quantities and are merely conve- 
nient labels applied to these quantities. 

In the present case, the operations are machine opera- 
tions performed in conjunction with a human operator. 
Usefid machines for performing the operations of the 3S 
present invention include general purpose digital com- 
puters or other similar devices. In all cases, there should 
be borne in mind the distinction between the method 
operations of operating a computer and the method of 
computation itself. The present invention relates to 40 
method steps for operating a computer and processing 
electrical or other physical signals to generate other 
desired physical signals. 

The present invention also relates to apparatus for 
performing these operations. This apparatus may be 4S 
specially constructed for the required purposes, or it 
may comprise a general purpose computer selectively 
activated or reconfigured by a computer program 
stored in the computer. The algorithms, methods and 
apparatus presented herein are not inherentiy related to 30 
any particular computer. In particular, various general 
purpose machines may be used with programs in accor- 
dance with the teachings herein, or it may prove more 
convenient to construct more specialized apparatus to 
perform the required method steps. The required struc- SS 
ture for a variety of these machines will appear fioin the 
description given below. Machines which may perform 
the functions of the present invention include those 
manufactured by Sony Corporation of America, as well 
as other manufacturers of computer systems. £0 

DETAILED DESCRIPTION OF THE 
INVENTION 

The present invention discloses apparatus and meth- 
ods for visually displaying time based multiple track £3 
interrelationships and available graphical user interface 
on a computer display. In the following description, 
numerous specific details are set forth such as computer 
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system configurations, window elements, icons, desktop 
sizes, metaphors, window configurations and arrange- 
ments, etc in order to provide a through tmderstandiag 
of the present invention. However, it will be apparent to 
one sldlled in the art. that the present Invention may be 
practiced without these specific de tai ls. In other in- 
stances, weU known circuits, structures and the like are 
not described in detail so as not to obscure the present 
invention unnecessarily. 

Referring to FIG. 1, the hardware configuration of 
the present invention b conceptually illustrated. FIG. 1 
illustrates a computer editing system for generating a 
window-based graphic user interface in accordance 
with the teachings of the present invention. As illus- 
trated, the computer editing system includes a computer 
20 which comprises four major components. The first of 
these is an input/ouQjut (I/O) drcnit 22, which b used 
to communicate information in ^propriately structured 
form to and bom other portions of the computer 20. In 
addition, computer 20 includes a centre! processing unit 
(CPU) 24 coupled to the I/O circuit 22 and to a mem- 
ory 26. These elements arc those typically found in most 
computers and, in £act. computer 20 is intended to be 
representative of a broad category of data processing 
devices. 

Also shown in FIG. 1 is a keyboard 30 for iiq>utting 
data and commattds into computer 20 through the I/O 
circuit 22, as b well knowtL Similarly, a CD ROM 34 b 
coupled to the I/O circuit 22 for providing additional 
programming capacity to the system illustrated in FIG. 
1. It will be appreciated that additional devices may be 
coupled to the comptiter 20 for storing data, such as 
magnetic tape drives, buffer memory devices, and the 
like. A device control 36 b coupled to both the memory 
26 and the I/O drcuit 22, to permit the computer 20 to 
communicate with multi-media system resources. The 
device cantral 36 controls operation of the multi-media 
resources to interface the multi-media resources to the 
computer 20. For example, in a video editing environ- 
ment, the computer 20 may be coupled through the 
device control 36 to a video tape recorder 40, a music 
synthesizer 42, an audio tape recorder 44, a special 
dfects resource 46, and a dis: player 41 as shown. The 
device control 36 may comprise an independent control 
and interface device or a software process for execution 
by tiie CPU 24. 

A display monitor 50 is coupled to the computer 20 
through the I/O circuit 22. Any well known variety of 
cathode ray tube (CRT), liquid crystal or other dbplays 
may be utilized as display monitor 50. A cursor control 
device 52 includes switches 54 and 56 for signally the 
CPU 24 in accordance with the teachings of the present 
invention. Cursor control device 52 (commonly re- 
ferred to a "mouse") permits a user to select various 
command modes, modify graphic data, and input other 
data utilizing switches 56 and 54. More particulariy, the 
cursor control device 52 permits a user to selectively 
position a cursor 58 at any desired location on a display 
screen 60 of the display 50. As illustrated in FIO. 1, the 
cursor 58 b disposed with a window 65 in the present 
invention's graphic user interface, to be describel more 
fully below. Moreover, in the presentiy preferred em- 
bodiment, the present invention's window-based user 
interface b generated and displayed using software 
stored in either memories 26, 32 or CD ROM 34, and 
executed by the CPU 24. 

In the presently preferred embodiment, the cursor 
control 52 utilizes well known apparatus and methods 
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for signaling CPU 24 of position changes of cursor 58 Referring to FIG. 2, a graphical user interface for a 

by movement of the ctirsor control over a surface. computer editing system configured in accordance with 
However, it will be appreciated by one skilled in the an the present invention is illustrated. The graphical user 

that a variety of well known cursor control devices may interface 200 permits a user of the computer editing 
be ii t i liw i by the present inventkin, including other 5 system to perform a nmnber of t«-editing functions. In 

control devices sndi as mechanical mice, trackballs, joy general, the graphical user interface 200 contains at 

sticks, grs^hic tablets, other keyboard iiqjuts and the least one Hm inline 210, vi^erein the timeline 210 displays 

Kke. The cursor control 52 in FIG. 1 is intended to any nnmber of soorce blocks arranged in a sequence. As 

encompass all such equivalent devices. descifeed above, during an earlier editing session. 

The graphical user mterface of present invention 10 source blocks are placed on each timeline which repre- 
displays informadon for re-editing associated with a scnts a time position in a final output sequence.' Al- 

darabase. Typically, the database is generated from a though a single timeline illustrated in FIG. 2, any nom- 

computer controlled editing system to incorporate and ber of tim rl ip'?? representing midtiple tracks oould be 

integrate various production media resources. As an displayed in accordance with the teachings of the pres- 

eiample, a computer controlled editing system config- 15 ent invention. In a preferred embodiment, the multiple 

ured in accordance with the present invention may tin ic lfnff; representing time sequences for multiple 

provide a means for a user of the computer controlled tracks con^rises one track of video and two tracks of 

editing system to generate source logs. The database audio. The timdine 210 is arranged in a horizontal di- 

comprises a plurality of source logs which are pointers rection be^nning at the left and extending to the right 

to selected portions of auxUo and/or video source mate- 20 However, the timeline may be arranged in a horizontal 

rial located on various media resources. Each source direction beginning at the tight and extending to the 

log comprises information such as a tape identifier, an left, or the timeline may be arranged in a vertical direc: 

start point, and end point, and any other information tion. 

useful for the editing and re-editing processes. The data- In addition to the timeline 210, the graphical user 
base also contains a total duration for each source tog. ZS interface 200 displays a timeline cursor 212 and a selec- 
Through use of the source logs, the computer editing tion cursor 201. The timeline cursor 212 is used in the 
system controls the various media resources to provide re-editing functions as is described more fuHy below, 
source material for editing or re-editing of a production. The placement of the selection cursor 201 on the graph- 
For example, to create a source log, a user may select a ical user interface 200 is controlled by the cursor con- 
media resource, such as a video tape player, and com- 30 trol device 52. The graphical user interface 200 permits 
mand the computer controlled editing system to capture selection of a number of re-edit functions. SpedficaUy, 
a selected portion of the video generated by the video the present invention provides for three trim functions 
tape player. and two insert functions. The three trim functions are 
The source log generated may comprise video and- selectable from Trim 1 select 227, Trim 2 select 22S, and 
/or any number of audio channels. The plurality of 35 Trim 3 select 221. The two insert functions are sdect- 
source logs generated for editing of a partkular multi- able by Insect 1 214 and Insert 2 215. The trim and the 
media production may be arranged into a file such that insert functions of the present invention may be select- 
the file contains source logs for the editing one-editing able through any means. The trim and insert le-edit 
of that particular production. As will be described more functions of the present invention are descrO}ed more 
fully below, the graphical user interfaoe of the present 40 fully below. 

invention operates in conjunction with the database The graphical user interface 200 provides for control 

comprising the source logs. Although the present in- and operation for the re-«dit functions. An edit control 

vention is described in coiuunction with a computer 235 permits entry of source blocks on the timeline 210, 

controlled editing system that generates source logs, and a delete control 238 allows deletion of a source 

any database comprising source material for use in a 43 block firom the timeline 210. A head and tail control 232 

computer controlled editing system could be used in and 230, respectively, control placement of the timeline 

accordance with the tr a r Jiings of the present inventioa cursor 212 and source blocks onto the timeline 210. The 

In a preferred embodiment, the computer editing placement of the timeline cursor 212 at either the head 

system of the present invention retrieves the source logs or tail of a respective source block can be achieved 

stored m the database during an earlier edit session, and 50 through selection of either head 232 or tail 230, respec- 

displays a corresponding source material block. Each tively. If the user selects the head control 232, then the 

source block contains a start point and an end point computer editing system performs re-edit functions on 

The start and the end points ddEine the available source the head portion of an adjacent source block. Altema- 

material for the particular source block. To generate an tively, if the user selects the taQ control 230, then the 

output sequence, the source blocks are entered onto a 55 computer editing system performs rc-edit functions on 

timeline in a sequential order. However, in generating the tail portion of an adjacent source block, 

the output sequence, it may be desirable to mclude only In addition to controlling the placement of the time- 

a portion of the available source material from a partic- line cursor 212 by the head and tail fimctions 232 and 

ukr source block. Therefore, the computer editing sys- 230, a rig^t arrow 234 and left arrow 236 move the 

tem permits selection of portions of any particular 60 cursor in the right and left directions, respectively. The 
source block. The begiiming of the selected portion of timpKiii> cursor is controlled by selection of right and 

the source block is defined as the "in" or "head" point, left arrows 234 and 236 in any mcremcnt desired. For 

and the closing of the selected portion of the source example, if source blocks displayed on a timeline iden- 

block is defined as the "out" or "tail" point A final tify frames of video, then selection of the right or left 

output sequence generated on the timeline comprises 65 arrow 234 and 236 results in movement of one video 

selected portions arranged such that a tail of a first frame. Also shown in FIG. 2 is an event number 214 and 

source block is adjacent to a head of a subsequent an enter duration 246. The event number 214 identifies 

source block. the origin of a particular source block, and the entire 
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duradoa displays the available length of a paiticulai created, the head point oa the source block E rrmains 

scarce block. In a preferred embodiment of the present adjacent to the tail point of source block Bl. The source 

invention, the graphical user interface 200 is viewed in block E is advanced through the timeline cursor 212 

conjunction with an additional display. The additional until the desired taS point is reached. The section be- 

display permits viewing of the source material simulta- S tween the head point and the tail point on the source 

ncously with display of corresponding source blocks on block E r epres ents the portion of the source block E 

the graphical user interface 200. Although a graphical desired for mseition on the timeline 210. After selection 

user interface is illustrated for control and operation of of the tail point on the source block E, the user sdects 

a number of re-editing functions, any control interface the Insert End 219 on the graphical user interface 200. 

could be used to manipulate and control the re-edit 10 Upon selecting the Insert End 219, the computer editing 

functions the present invention without deviating from system of the present invention inserts the source mate- 

the spirit and scope of the invention. rial contained on the source block E between the head 

Referring to FIGS. Sa-e, a graphical user mtei&ce and tail points as shown in FIG. 3e. The portion of the 

for a re^t insert function configured in accordance new source material inserted is designated E' to repre- 

with the present mveotion is illostrated. An Insert I IS sent that a portion of the source block E is insetted, 

function of the present invention permits a user of the After the re-edit Insert 1 function in the present escam- 

computer editing system to insert material contained on pie b executed, the source block A is shifted on the 

a source block into the sequence of source blocks on the timeline 210, in a reverse direction, a distance equal to 

timeline much like creating a splice on motion picture the source material E'. Likewise, the source block 61, 

film. The Insert 1 function of the present mvention 20 bifurcated from the insertion, is shifted in a reverse 

inserts a new source block onto the timeline 210 without direction on the timeline 210 a distance E'. 

erasing or overlaying any of the existing source blocks. Referring to FIGS, ia-e, a graphical user interface 

For purposes of explanation, a portion of a timeline for an overlay re-edit function configored in accor- 

containing three source blocks designated A, B and C dance with the present invention is illustrated. The 

are illustrated in FIG. 3a. In order to execute the Insert 23 computer editing system of the present invention per- 

1 function, the user of the computer editing system mitsoveilayingofsclcctcd source material onto cidsting 

' places the timeline cursor 212 in a position for which source material via an Insert 2 functioa The Insert 2 

the insertion is desired. For the example shown in function, like the Insert 1 function, permits insertion of 

FIGS. 3a-e, the timeline cursor 212 resides in the center new Eovrce material onto existing source material on 

of the source block B. 30 the trmplmp in a re-edit session. However, the Insert 2 

Upon selection, new source material, designated as function of the present invention overlays the new 

source block Eon FIG. 3/>, is placed on the timeline 200 source material onto the existing source blocks. For 

by the computer editing system such that the start of the purposes of explanation, the timeline shown tn FIG. 4a 

source block E is adjacent to the timeline cursor 212. depicts source blocks A, B, C and D. A new source 

The selection of new source material for p l ace men t on 35 block, designated as source block E, is placed on the 

the timeline 200 may be accomplished through any timeline 210 for re-edit. The timeline cursor 212 is 

means without deviating from the spirit and scope of placed on the timeline at a point for which insertion of 

the invention. The Insert I function is then initiated by source material is desired. For the example shown , m 

the user through the graphical user interface 200 by FIGS. 4a-e, the timeline cursor 212 is placed at the tail 

placing the selection cursor 201 over the Insert 1 fimc- 40 point of source block B. However, the insertion of the 

tion select 217 and depressing a key on the ciusor con- new source material need not occur at a head or tail 

trol device 52. Upon selecting the Insert 1 function, the point, but may occur anywhere on the timeline 210. 

user selects a head point on the source block E to mark After placing tiie cursor and the new source block E on 

the beginning of the source material for which insert on the timeline, the user selects a head point for the source 

the timeUne 210 is desired. To designate a head point on 4J block E As described above in conjunction with the 

the source block E, the user selects the right arrow Insert 1 function, the user selects the right arrow 234 on 

(unction 234 on the graphical user interface 200. In the graphical user uiter&ce 200 to advance the source 

response, the source block E is advanced in a right to block E forward in time on the timeline. As shown in 

left direction. For the example illusixated in FIGS. 3a-e, FIG. *b, a head point for the source block E is selected, 

the source block E is advanced to a head point desig- 50 Upon selection of the head point, the source block E 

nated "Head". In a preferred embodiment, the head is further advanced for selection of a tail point For the 

point is selected via the head selection control 232, example illustrated in FIGS. 4a-e, the bead and tail 

whereupon the computer editing system indicates selec- points for the new source block B are shown in PIG. 4c. 

tion of the head point as shown in FIG. 3c. In a second After designating the tail point, the user selects the 

embodiment, the user selects the bead point for the 55 Insert End 219 fiinction on the graphical user interface 

source block E prior to the selection of the Insert 1 . 200. The computer editing system' of the present mven- 

function. In the second embodiment for the example tion overlays the selected source material between the 

illustrated in FIGS. 3a-e, upon selecting the head pomt head point and the tail point from the source block E on 

and then the Insert 1 function, the computer editing top of the source block C As shown m FIG. Ad, new 

system displays the arrangement shown in FIG. 3c: 60 source material E', representing the portion between 

After the head point for the source block E is se- the head point and tail the point, is shown. Also, the 

tected, the user advances the source block E for selec- source block C, now designated C, is shortened as a 

tion of a tail point For the example shown in FIGS. result of the overlay function. Note for the Insert 2 

3(i-«, the source block B is advanced via the right arrow function of the present invention, because the head and 

234 to place the desired tail point location within the 65 tail |K)ints for the new source block E were selected for 

timeline cursor 212. As shown in FIG. 3d, as the source placement only in source block C, the source blocks A, 

block E is advanced, a separation is created between the B and O are not affected, such that the source blocks 

original Bl and B2 source blocks. As the separation is retain their original position on the timeline. FIG. 4e 
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iUostrates the somce block E in a Trim 3 mode. The di^Iayed. To select a new head point, the nscr, through 
Trim 3 mode permits the user to view all existing source die graphical user interface 200, moves the source mate- 
block material from the start to the end of the source rial m a reverse directioa in rdation to the timrlinp as 
block E. The operation of the present invention Trim 3 shown in FIG. Se. The user shifts the source material in 
mode is described more fully below. 5 source block B such that the desired head point is lo- 

Referring to FIGS. Sa-S/, a graphical user interface cated within the timeline cursor., 
for a Trim 1 function re-edit function configured in When the desired head point is within the timeline 
accordance with the present invention is illustrated. cursor, the user selects the head point The current 
The Trim 1 function permits a user of the computer source material containing the new head point and tail 
editing system to view and select existing source mate- 10 point is designated as B". The current source material 
rial in a source block during a re-edit session. Specifi- 6" comprises a different duration length tHan the origi- 
cally, the Trim 1 fimction permits a user to edit the head nal source material B. When the user has completed the 
point, tail point, or any combination thereof, for a se- re-edit session, the user selects the Trim End fimction 
lected source block. In the Trim 1 mode, if the duration 223 on the graphical user interface 200. The computer 
of a source block selected b altered through selection of IS editing system of the present invention then displays the 
new head and/or tail points, the other source blocks on new current source materia] B" as re-edited. As shown 
the timeline are affected accordingly. For purposes of in FIG. Sf, the change in duration of the current source 
explanation, four source blocks, designated A, B, C, and material B" results in a shift of source blocks A, C and 
D are illustrated in FIG. Sa. To perform a Trim I ftmc- D on the timdine. 

tion, the user places the timeline cursor 212 at the head 20 Referring to HGS. 6a-d, a graphical user faiterfacc 
or tail of a source block for which a re-edit is desired. for a Trim 2 function configured in accordance with the 
For the example illnstrated in FIGS. Sa-/, the timeline present mvention is illustrated. The Trim 2 function of 
cursor 212 is placed at the tail of source block B using the present invention permits a user to perform re-edit 
the tail sdcct 230 on the graphical user interface 200. operations on existing source block material In contrast 
Upon placement of the timeline cursor in a desired 25 to the Trim 1 function, the Trim 2 function does not 
head or tail location, the user selects the Trim 1 function displace in time nnpyiitf/i source blocks on the timeline, 
from the graphical user interface 200 via the Trim 1 FIG. 6a depicts four source blocks A, B, C and D on a 
select 227. In addition to selecting the Trim 1 function, timeline. The user positions the timeline cursor between 
the user selects cither right view 242 or left view 240 two source blocks for which the re-edit is desired. For 
selects. The selection of the right view 242 or the left 30 the example shown in FIGS, ia-d, re-edits of die tail 
view 240 is indicated through ilhunination of the re- point of source block B and the head point of somce 
spective border areas on the graphical user interface block C are desired. As shown in FIG. 66, the source 
200. In a. preferred embodiment, the selected right or material for the end of source block B and start of 
left view border is illuminated, while the border area for source block C extends beyond the original edit illus- 
the inactive view is darkened. For the example illus- 35 trated in FIG. €a. In order to perform the re-edit, the 
trated inFIGS. Sfl-/ if the right view 242 is selected for User selects the Trim 2 select 225 on the grs^ihical user 
modification of the tail point, tiien all existing source interface 200. 

material for the source block B is shown beginning at After invoking the Trim 2 function, the user selects 
the headi pomt and extending to the end point as shown either the right arrow 234 or left arrow 236 to perform 
in FIG. $b. In flie right view perspective, the adjacent 40 the re-edit For the example shown in FIGS. 6a-d, the 
source block C is not shown on the timeline, and the user selects the left arrow 236 causing the source block 
source block B is displayed m a diSerent color and size B to extend along the timeline in a reverse direction. As 
than source block A. In the right view perspective, the shown in FIG. 6c, the source block B comprises a new 
user is permitted to view all existing source material for tail point and the source block C comprises a new head 
the source block B residmg right of the cursor thereby 45 point Therefore, using the Trim 2 function of the pres- 
allowing the user to select a new tail point To select a ent invention, the user may adjust the head point of 
new tail point in the present example, the user, through source block C and the tail point of source block B in 
use of the ri^t arrow 234, advances the source block B accordance with the positioning of the timeline cursor, 
in time resulting m the source material moving in a right After the user positions the cursor to select the new 
to left direcdoa The user advances the source material SO head point for source block C and tail point for source 
contamed in source block B until the desired tail point is block B, the user selects the Trim End 232 select on the 
located within the timeline cursor. The selection of a graphical user interface 200. The computer editing sys- 
tail point for the present example, designated Taili is tem of the present invention then displays the new re- 
illnstrated in FIG. Sc. edit timeline as shown in FIG. 6d. The source block B, 

The selected source material comprising the new SS comprising a new tail point is designated as B', and the 
Taili point for the original source block B is designated source block C, comprising a new head point is desig- 
B'. For the present example, the new Taili lies to the nated as C. In contrast to the Trim 1 function, the Trim 
right of Taili, the previous tail point Therefore, the 2 function retains synchronization for adjacent source 
duration of the source material for B' is greater than the blocks on the timeline. For the example shown in FIGS, 
duration source material B. A user may also desire to 60 ia-d, the source blocks A and D remain iinr-hangf^l in 
change the original head point for the source material both duration and positioning on the timeline. In order 
B. To accomplish this task, the user selects the left view to affect the positioning of adjacent source blocks. Trim 
via the left view select 240 on graphical user interface 1 mode is used. 

200. Upon invoking the left view perspective, the com- Referring to FIGS, la-d, a graphical user interface 
puter editing system of the present invention displays 65 for a Trim 3 mode configured in accordance with the 
the entire available source material in the source block present invention is illustrated. The Trim 3 mode per- 
B left of the timeline cursor. As shown in FIG. Sd, the mils re-editing of a single source block. An example 
source block B from the start point to the tail point is timeline is illustrated in FIG, la containing source 
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blocks A, B, C and D. To perform a rc-cdit in the Trim 
3 mode, the user places the tunelise cursor at the head 
or tall of the source block for v^ch re-editing is de> 
sired, and selects the Trim 3 select 221 on the graphical 
user interface 200. For the example illustrated in FIGS, i 
la-d, the source block B is chosen for re-edit. The Trim 
3 mode permits the user to change both the head and tail 
points, simultaneously. The selection of new head and 
tan points in conjunction with the trim 3 fonction of the 
present invention is accomplished through ezpUdtly 10 
selecting dther a new head or tail point at the timeline 
cursor resulting in the computer editing system select- 
ing a corresponding new tail or head point For the 
example of FIGS, la-d, placement of the timeline cur- 
sor at the bead point is illustrated. In order to change IS 
the head and tail poims on the source block B, the user 
scrolls through the source block B with the use of the 
light arrow or left arrow selects 234 and 236 respec- 
tively. 

For the example of FIGS, la-d, the user, via the left 20 
arrow select 231$ on the graphical user interface 200, 
moves the source block B in a reverse direction. When 
the new head point desired b placed underneath the 
timeline cursor, the user selects the Trim End select 223 
on the graphical user interface 200. Upon mvocation of 23 
the Trim End function, the computer editing system of 
the present invention displays the new source block B 
with the new head and tail points. The selection of a 
new head point, as shown in FIGS, la-d, results in 
automatic selection of a corresponding tail point by the 30 
computer editing system. Alternatively, selection of a 
new tail point results in automatic selection of a corre- 
sponding head point by the computer editing system. 
The Trim 3 function of the present invention does not 
displace the position of adjacent source blocks on the 33 
timeline. For the example shown in FIGS, la-d, the 
source blocks A, C and D retain the same position and 
duration on the timeline. 

Although the present invention has been described in 
terms of a preferred embodiment, it will be appreciated 40 
that various modifications and alterations might be 
made by those skilled in the art without departing from 
the spirit and scope of the invention. The invention 
should therefore be measured in terms of the claims 
which follow. 43 

What is claimed is: 

1. In a computer controlled editing system for editing 
a multi-media production including a central processing 
imit (CPU) coupled to a display device and storage 
means coupled to said CPU, a method for displaying SO 
' available source material for editing comprising the 
steps of: 

staring a plurality of source logs comprising a start 
point end an end point identifying all available 
source material for editing by said computer con- 55 
trolled editing system; 

displaying, on said display device, at least ooe se- 
quence of a plurality of source material blocks on a 
timeline such that a tail point of a first source mate- 
rial block b adjacent to a head point of a subse- 60 
quent source material block on said timeline, said 
head and tail points for each source material block 
displayed defining up to all of said available source 
material identified by a corresponding sotuoe lo^ 

providing a means to select 8 source material block 65 
for re-editing including providing a means to indi- 
cate a point on said selected source material block 
for which re-edit is desired; 
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selecting a re-edit function; and 

displaying, on said display device upon selection of 
said re-edit function, available source material re- 
quired for said re-edit function selected and corre- 
sponding to said selected source material block and 
said point indicated by distinguishing said available 
source material from said source material blocks on 
said timeline by size, color and relative layering. 

2. The method for displaying available source mate- 
rial for editing as claimed in claim 1 wherein the step of 
displaymg at least one sequence of a plurality of source 
material blocks on a timeline comprises the step of dis- 
playing a plurality of sequences of source materia] 
blocks showing trmj* interr^tionships, each of said 
plurality of sequences of source material blocks repre- 
senting one track for a multi-track production. 

3. The method for displaying available source mate- 
rial for editing as claimed in claim 1 wherein the step of 
providing a means to indicate a point on said source 
material block comprises the step of providing a time- 
line cursor extending through said source material 
blocks on said timeline. 

4. The method of displaying available source material 
for editing as claimed in claim 1 wherein the step of 
selecting a re-edit fimction comprises the step of select- 
ing an insert "1" function, wherein said insert "1" func- 
tion permits insertion of new source material at said 
point indicated. 

5. The method for displaying available source mate- 
rial for editing as claimed in daim 4 further comprisiag 
the steps of: 

displaying new source material, starting at said point 
indicated, for. which insertion is desired by distin- 
gitishing said new source material from said source 
material blocks displayed on said timeline by size, 
color and relative layering; 

advancing said new source material along said time- 
line; 

selecting a head point on said new source material 
when said head point desired is within said pomt 
indicated; 

advancing said sotirce material along said timeline 
while displaying said selected source material 
block at said point indicated separation from a 
subsequent source material block on said timelme; 

selecting a tail point on said new source material 
when said tail point desired is withm said pomt 
indicated; 

terminating said insert "1" function; and 
displaying said new source material, from said head 
point to said tail point, on said timeline starting at 
said point mdicated such that said plurality of 
source material blocks are displayed in a continu- 
ous sequence. 

6. The method for displaying available source mate- 
rial for editing as claimed in claim 1 wherein the step of 
selecting a re-edit function comprises the step of select- 
ing an insert "2" function, wherein said insert "2" func- 
tion permits overlay of new source material onto exist- 
ing source material block. 

7. The method for displaying available source mate- 
rial for editing as claimed in claim 6 further comprising 
the steps of: 

displaying new source material, starting at said point 
indicated, for which overlay is desired by distin- 
guishing said new source material from said source 
material blocks displayed on said timeline by size, 
color and relative layering; 
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advancing said new source material along said time- 
line; 

selecting a head point on said new source material 
when said head point desired is within said point 
indicated; S 

selecting a tail point on said new source material 
when said tail point desired is within said point 
indicated; 

terminating said insert "2" function; and 

displaying said new source material upon termina- 10 
tion, from said head point to said tail point, on said 
timftlinft starting at said point indicated so as to 
overlay said existing source material blocks on said 
timeline. 

8. The method for displaying available source mate- IS 
rial for editing as claimed in claim 1 wherein the step of 
sdecting a re-edit function comprises the step of select- 
ing a trim "1" function, wherein said trim '1' function 
permits selection of a new tail and head point for an 
existing source material block so as to alter positions of 20 
source material blocks adjacent to said existing source 
material block displayed en said timeline. 

9. The method for displaying available source mate* 
rial for editing as claimed in claim 8 further comprising 
the steps of: 25 

selecting a right and a left view for said selected 
source material block; 

displaying, in response to selection of said left view, 
available source material for said selected source 
material block residing left of said point indicated 30 
by distinguishing said sheeted source material 
block from said sooroe material blocks displayed 
on said timeline by size, color and relative layering; 

advancing said selected source material block along 
said timeline; 3S 

selecting a tail pomt on said source material block 
selected when said tail point desired is within said 
point indicated and said left view is selected; 

displaying, in response to selection of said right view, 
available source material for said selected source 40 
material block residing right of said point indicated 
by distinguishing said selected source material 
block from said source material blocks displayed 
on said timeline by size, color and relative layering 

selecting a head point on said selected source material 45 
when said head point desired is within said point 
indicated and said li^ view is selected; 

terminating said trim "1" function; and 

displaying said new soim% material upon termina- 
tion, from said head point to said tail point, on said SO 
timeline so as to alter positions of said adjacent 
source material blocks displayed on said timeline. 

10. The method for displaying available source mate- 
rial for editing as claimed in claim 1 wherein the step of 
selecting a re-edit fimction comprises the step of select- 55 
ing a trim "2" function, wherein said trim "2" function 
permits exchanging additional source material for said 
selected source material block such that exchanging 
said additional source material in said selected source 
material adjusts source material in a second existing 60 
source material block. 

11. The method for displaying available source mate- 
ria] for editing as claimed in claim 10 further comprising 
the steps of: 

di^laying available source material for said selected 65 
source material block by distinguishing said se- 
lected source material block and said second exist* 
ing source material block from said source material 



blocks displayed on said timdine by size, color and 

relative layering 
advancing said selected source material block along 

said timeline so as to change rdative positioning of 

said second cxi sting source block; 
selecting changing source material on said selected 

source material block when a tail or head point 

desired is within said point indicated; 
terminating said trim "2" function; and 
displaying said source material block selected and 

said second existing source material block on said 

timeline reflecting selection of a new head or tail 

point on said selected source material block and 

said second existing source block. 

12. The method for displaying available source mate- 
rial for editing as claimed in claim 1 wherein the step of 
selecting a re-edit function comprises the step of select- 
ing a trim "3" function, whcrdn said trim "3" fimction 
permits selection of a . new tail and head point simulta- 
neously for said source material block selected. 

13. The method for displaying available source mate- 
rial for editing as claimed in claim 12 further comprising 
the steps of: 

displaying available source material for said selected 
source material block by distinguishing said se- 
lected source material block bom said source mate- 
rial blocks displayed on said timeline by size, color 
and relative layering; 

advancing said selected source material block along 
said timeline in a forward and reverse directions; 

selecting a head/taO point on said selected source 
material block when said head/tail pomt desired is 
within said point indicated; 

terminating said trim "3" fimction; and 

displaying said selected source material block on said 
timeline reflecting selection of said head/tail pomt 
on said source material block selected. 

14. In a computer controlled editing system for edit- 
ing a multi-media production including a central pro- 
cessing unit (CPU) coupled to a display device, an ^pa- 
rattts for displaying available source material for editing 
comprising: 

storage means coupled to said CPU for storing a 
plurality of source logs comprising a start point and 
an end point identifying all available source mate- 
rial for editmg by said computer controlled editing 
system; 

graphical user interface (GUI) means coupled to said 
CPU, storage means and said display device for 
providing a man to machine interface for said com- 
puter controlled editing system, said GUI means 
comprising a timeline and a plurality of source 
material blocks each having a head point and a tail 
point, said head and tail points for each source 
material block defining up to aU of said available 
source material identified by a corresponding 
source log, said GUI means comprising; 

selection means for selecting a source material block 
for re-editing including providing a means to indi- 
cate a point on said source material block selected 
for wUch re-edit is desired, said selection means 
providing a means for selecting a re-edit fimction, 
and 

display means for displaying, on said display device, 
at least one sequence of a plurality of source mate- 
rial blocks on said timeline such that a tail point of 
a first source material block is adjacent to a head 
point of a subsequent source material block on said 
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timeline, said display means displaying, on -said 
display device upon selection of said re-edit lunc- 
tion, available source material required for said 
re-edit function selected and corresponding to said 
selected source material block and said point indi- S 
cated by distinguishing and available source mate- 
rial from said source material blocks displayed on 
said timeline by size, color and relative layering. 

15. Tlie apparatus for displaying available source 
material for editing as r.latmrd in claim 14 uiierein said ^0 
graphical user interface means comprises a plurality of 
sequences of source material blocks showing time inter- 
relationships, each of said pluraUty of sequences of 
source material blocks representing one track for a 
multi-track production. 

16. The apparatus for displaying available source 
material for editing as claimefd in claim 14 wherein said 
selection means comprises a timeline cursor extending 
through said soiu'ce material blocks on said timeline. 

17. The apparatus for displaying available source ^ 
material for editing as claimed in claim 14 wherein said 
means for selecting a re-edit function con^irises means 
for selecting an insert "1" function, wherdn said insert 
"1" function permits insertion of new source material at 
said point indicated. 

18. The apparatus for displaying available source 
material for editing as claimed in claim 17 farther com- 
prising: 

means for displaying new source material, starting at 
said point indicated, for which insertion is desired 
by distinguishing said new source material from 
said source material blocks displayed on said time- 
line by size, color and relative layering; ' 

means for advancing said source material along said 35 
timeline; 

means for selecting a head point on said new source 
material when said head point desired is within said 
point indicated; 

means for advancing said source material along said 4^ 
timeline while displaying said selected source ma- 
terial block at said point indicated separation from 
a subsequent source material block on said timeline; 

means for selecting a tail point on said new source 
material when said tail point desired is within said 4$ 
point indicated; 

means for terminating said insert "1" function; and 

means for displaying said new source material, from 
said head point to said tail point, on said timeline 
starting at said point indicated such that said plural- 50 
ity of source material blocks are displayed in a 
continiious sequence. 

19. The apparatus for displaying available source 
material for editing as claimed in claim 14 wherein said 
means for selecting a re-edit function comprises means S5 
for selecting an insert "2" function, wherein said insert 
"2" function permits overlay of new source material 
onto an existing source material block 

20. The apparatus for displaying available source 
material for editing as claimed in claim 19 further com- 60 
prising: 

means displaying new source material, starting at said 
point indicated, for which overlay is desired by 
distinguishing said new source material from said 
source material blocks displayed on said timeline 6S 
by size, color and relative layering 

means for advancing said new source material along 
said timeline; 
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-means for selecting a head point on said new source 
material when said head point desired is within said 
point indicated; 

means for selecting a tail point on said new source 
material when said tail point desired is within said 
point indicated; 

means for terminating said insert "7' function; and 

means for displaying said new source material upon 
termination, firom said head point to said tail point, 
on said tunfeUne starting at said point indicated so as 
to overiay said existing source materia! blocks on 
said tj-m fftiWr, 

21. The apparatus for displaying available source 
material for editing as claimed in claim 14 wherein said 
means for selecting 3 re-edit function oonq>rises means 
for selecting an a trim "1" function, wherein said trim 
"1" function permits selection of a new tail and head 
point for an ensting source material block so as to alter 
positions of said adjacent source material blodcs on said 
timelme. 

22. The apparatus for displaying available source 
material for editing as claimed in claim 21 further com- 
prising: 

means for selecting a right and a left view for said 
selected source material block; 

means for displaying, in response to selection of said 
left view, available source material for said selected 
source material block residing left of said point 
indicated by distinguishing said selected source 
material blo(^ from said source material blocks 
displayed on said timdine by size, color and rela- 
tive layering; 

meaiis for advancing said selected source material 
block along said timeline; 

means for selecting a tail point on said selected source 
material block when said tail point desired is within 
said point indicated and said left view is selected; 

means for displaying, in response to selection of said 
right view, available source material for said se- 
lected source material block residing right of said 
point indicated by distinguishing said selected 
source material block from said source material 
blocks displayed on said timeline by size, color and 
relative layering; 

means for selecting a head point on said selected 
source material when said head point desired is 
within said point indicated and said right view is 
selected; 

means for terminating said trim "1" function; and 
means for displaying said selected source material 
block upon termination of said trim "1" function, 
from said head point to said tail point, on said time- 
line so as to alter positions of source material 
blocks adjacent to said new source material dis- 
' played on said timeline. 

23. The apparatus for displaying available source 
material for editing as claimed in claim 14 wherein said 
means for selecting a re-edit fimction comprises means 
for selecting a trim "2" function, wherein said trim "2" 
function permits changing source material for said se- 
lected source material block such that changing source 
materia] in said selected source material block adjusts 
source material in a second existing source material 
block. 

24. The apparatus for displaying available source 
material for editing as claimed in claim 23 further com- 
prising: 
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means for displaying available soorce material for 
said selected source material block by distingnish- 
ing said selected source material block and said 
second existing source material block from said 
source material blocks displayed on tim^liTH' s 
by size, color and relative layering; 

means for advancing said selected source material 
block along said timeline so as to change relative 
positioning of said second existing source block; 

means for selecting changing source material on said 10 
selected sotirce material block when a tafl or head 
point desired is within said point indicated; 

means for terminating said trim "2" function; and 

means for displaying said selected source material 
block and said second eikring source material IS 
block on said timeline reflecting selection of a new 
head or tail point on said selected source material 
block and said second listing source block 

25. The apparatus for displaying available source 
material for editing as claimed in claim 14 wherein said 20 
means for selecting a re-edit function comprises means 
for selecting a trim "3" function, wherein said trim "3" 
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function permits selection of a new tail and head point 
simultaneously for said selected source material block. 

26. The apparatus for displaying available source 
material for editing as claimed in claim 25 further com- 
prising: 

means for displaying available source material for 
said selected soorce material block by distinguish- 
ing said selected source material block from said 
source material blocks displayed on said timeline 
by size, color and relative layering; 

means for advancing said selected source material 
block along said timeline in a forward and reverse 
directions; 

means for sdecting a head/tail point on said selected 
source material block when said bead/tail point 
desired is within said point indicated; 
means for terminating said trim "3" function; and 
means for displaying said selected source material 
block on said timeline reflecting selection of said 
head/tail point on said selected source material 
block. 

* * • * • 
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